Pandas Profiling Report

Dataset statistics

Number of variables	14
Number of observations	38765
Missing cells	164
Missing cells (%)	< 0.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	4.1 MiB
Average record size in memory	112.0 B

Variable types

Numeric	13
DateTime	1

Alerts

`df_index` is highly correlated with `sensorParms(5)`	High correlation
`_RS232Dpt` is highly correlated with `sensorParms(1)` and 1 other fields	High correlation
`sensorParms(1)` is highly correlated with `_RS232Dpt` and 2 other fields	High correlation
`sensorParms(2)` is highly correlated with `sensorParms(1)`	High correlation
`sensorParms(5)` is highly correlated with `df_index`	High correlation
`sensorParms(7)` is highly correlated with `sensorParms(8)`	High correlation
`sensorParms(8)` is highly correlated with `sensorParms(7)`	High correlation
`sensorParms(9)` is highly correlated with `_RS232Dpt` and 1 other fields	High correlation
`sensorParms(10)` is highly correlated with `sensorParms(11)`	High correlation
`sensorParms(11)` is highly correlated with `sensorParms(10)`	High correlation
`df_index` is highly correlated with `sensorParms(5)` and 1 other fields	High correlation
`_RS232Dpt` is highly correlated with `sensorParms(1)` and 1 other fields	High correlation
`sensorParms(1)` is highly correlated with `_RS232Dpt` and 3 other fields	High correlation
`sensorParms(2)` is highly correlated with `sensorParms(1)` and 1 other fields	High correlation
`sensorParms(5)` is highly correlated with `df_index` and 1 other fields	High correlation
`sensorParms(6)` is highly correlated with `df_index` and 1 other fields	High correlation
`sensorParms(7)` is highly correlated with `sensorParms(8)`	High correlation
`sensorParms(8)` is highly correlated with `sensorParms(7)`	High correlation
`sensorParms(9)` is highly correlated with `_RS232Dpt` and 1 other fields	High correlation
`sensorParms(10)` is highly correlated with `sensorParms(11)`	High correlation
`sensorParms(11)` is highly correlated with `sensorParms(1)` and 2 other fields	High correlation
`_RS232Dpt` is highly correlated with `sensorParms(9)`	High correlation
`sensorParms(1)` is highly correlated with `sensorParms(2)`	High correlation
`sensorParms(2)` is highly correlated with `sensorParms(1)`	High correlation
`sensorParms(7)` is highly correlated with `sensorParms(8)`	High correlation
`sensorParms(8)` is highly correlated with `sensorParms(7)`	High correlation
`sensorParms(9)` is highly correlated with `_RS232Dpt`	High correlation
`sensorParms(10)` is highly correlated with `sensorParms(11)`	High correlation
`sensorParms(11)` is highly correlated with `sensorParms(10)`	High correlation
`df_index` is highly correlated with `sensorParms(2)` and 3 other fields	High correlation
`_RS232Dpt` is highly correlated with `sensorParms(1)` and 2 other fields	High correlation
`sensorParms(1)` is highly correlated with `_RS232Dpt` and 9 other fields	High correlation
`sensorParms(2)` is highly correlated with `df_index` and 11 other fields	High correlation
`sensorParms(3)` is highly correlated with `df_index` and 9 other fields	High correlation
`sensorParms(4)` is highly correlated with `sensorParms(1)` and 6 other fields	High correlation
`sensorParms(5)` is highly correlated with `sensorParms(1)` and 6 other fields	High correlation
`sensorParms(6)` is highly correlated with `df_index` and 9 other fields	High correlation
`sensorParms(7)` is highly correlated with `sensorParms(2)` and 5 other fields	High correlation
`sensorParms(8)` is highly correlated with `sensorParms(1)` and 8 other fields	High correlation
`sensorParms(9)` is highly correlated with `_RS232Dpt` and 2 other fields	High correlation
`sensorParms(10)` is highly correlated with `sensorParms(1)` and 8 other fields	High correlation
`sensorParms(11)` is highly correlated with `df_index` and 7 other fields	High correlation
`sensorParms(4)` is highly skewed (γ1 = 36.49924599)	Skewed
`sensorParms(8)` is highly skewed (γ1 = 20.25822299)	Skewed
`df_index` is uniformly distributed	Uniform
`df_index` has unique values	Unique
`TIMESTAMP` has unique values	Unique
`sensorParms(5)` has 15194 (39.2%) zeros	Zeros

Reproduction

Analysis started	2022-08-30 20:13:52.567306
Analysis finished	2022-08-30 20:14:50.876529
Duration	58.31 seconds
Software version	pandas-profiling v3.2.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
UNIFORM
UNIQUE

Distinct	38765
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	19384

Minimum	2
Maximum	38766
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	303.0 KiB

Quantile statistics

Minimum	2
5-th percentile	1940.2
Q1	9693
median	19384
Q3	29075
95-th percentile	36827.8
Maximum	38766
Range	38764
Interquartile range (IQR)	19382

Descriptive statistics

Standard deviation	11190.63593
Coefficient of variation (CV)	0.577313038
Kurtosis	-1.2
Mean	19384
Median Absolute Deviation (MAD)	9691
Skewness	0
Sum	751420760
Variance	125230332.5
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2	1	< 0.1%
25840	1	< 0.1%
25842	1	< 0.1%
25843	1	< 0.1%
25844	1	< 0.1%
25845	1	< 0.1%
25846	1	< 0.1%
25847	1	< 0.1%
25848	1	< 0.1%
25849	1	< 0.1%
Other values (38755)	38755	> 99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%
10	1	< 0.1%
11	1	< 0.1%

Value	Count	Frequency (%)
38766	1	< 0.1%
38765	1	< 0.1%
38764	1	< 0.1%
38763	1	< 0.1%
38762	1	< 0.1%
38761	1	< 0.1%
38760	1	< 0.1%
38759	1	< 0.1%
38758	1	< 0.1%
38757	1	< 0.1%

TIMESTAMP
Date

UNIQUE

Distinct	38765
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	303.0 KiB

Minimum	2020-06-09 15:14:06
Maximum	2022-08-19 01:18:29

Histogram

Histogram with fixed size bins (bins=50)

_RS232Dpt
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	3035
Distinct (%)	7.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	32.86470989

Minimum	0.836
Maximum	81
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	303.0 KiB

Quantile statistics

Minimum	0.836
5-th percentile	4.045
Q1	16.09
median	32.02
Q3	47.99
95-th percentile	67.9
Maximum	81
Range	80.164
Interquartile range (IQR)	31.9

Descriptive statistics

Standard deviation	19.80243126
Coefficient of variation (CV)	0.6025439241
Kurtosis	-0.9299224244
Mean	32.86470989
Median Absolute Deviation (MAD)	15.93
Skewness	0.2488451968
Sum	1274000.479
Variance	392.1362839
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
45.06	86	0.2%
47.06	83	0.2%
50.07	82	0.2%
47.08	82	0.2%
47.07	82	0.2%
38.07	80	0.2%
48.08	80	0.2%
21.09	80	0.2%
26.07	80	0.2%
14.08	79	0.2%
Other values (3025)	37951	97.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.836	1	< 0.1%
0.839	1	< 0.1%
0.844	1	< 0.1%
0.848	1	< 0.1%
0.849	1	< 0.1%
0.85	1	< 0.1%
0.851	1	< 0.1%
0.852	2	< 0.1%
0.854	1	< 0.1%
0.855	2	< 0.1%

Value	Count	Frequency (%)
81	6	< 0.1%
80.9	1	< 0.1%
80.8	1	< 0.1%
80.7	1	< 0.1%
80.5	2	< 0.1%
80.2	2	< 0.1%
80.1	2	< 0.1%
80	11	< 0.1%
79.99	1	< 0.1%
79.98	1	< 0.1%

sensorParms(1)
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	8632
Distinct (%)	22.3%
Missing	135
Missing (%)	0.3%
Infinite	0
Infinite (%)	0.0%
Mean	6.186702874

Minimum	2.815
Maximum	36.56
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	303.0 KiB

Quantile statistics

Minimum	2.815
5-th percentile	3.655
Q1	4.795
median	5.376
Q3	6.461
95-th percentile	12.73055
Maximum	36.56
Range	33.745
Interquartile range (IQR)	1.666

Descriptive statistics

Standard deviation	2.707698267
Coefficient of variation (CV)	0.4376641844
Kurtosis	9.431374419
Mean	6.186702874
Median Absolute Deviation (MAD)	0.7
Skewness	2.593844343
Sum	238992.332
Variance	7.331629908
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
4.805	35	0.1%
4.681	34	0.1%
4.837	33	0.1%
4.816	32	0.1%
5.244	32	0.1%
4.781	31	0.1%
4.842	31	0.1%
4.782	30	0.1%
4.778	30	0.1%
4.774	30	0.1%
Other values (8622)	38312	98.8%
(Missing)	135	0.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2.815	1	< 0.1%
2.816	4	< 0.1%
2.817	2	< 0.1%
2.818	1	< 0.1%
2.819	5	< 0.1%
2.82	3	< 0.1%
2.821	2	< 0.1%
2.822	2	< 0.1%
2.823	4	< 0.1%
2.824	1	< 0.1%

Value	Count	Frequency (%)
36.56	1	< 0.1%
34.73	1	< 0.1%
34.49	1	< 0.1%
32.71	1	< 0.1%
31.07	1	< 0.1%
30.73	1	< 0.1%
30.65	1	< 0.1%
30.53	1	< 0.1%
30.45	1	< 0.1%
30.43	1	< 0.1%

sensorParms(2)
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1468
Distinct (%)	3.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	30.21090881

Minimum	26.66
Maximum	60.21
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	303.0 KiB

Quantile statistics

Minimum	26.66
5-th percentile	27.42
Q1	29.06
median	29.68
Q3	30.62
95-th percentile	35.84
Maximum	60.21
Range	33.55
Interquartile range (IQR)	1.56

Descriptive statistics

Standard deviation	2.384660191
Coefficient of variation (CV)	0.07893374563
Kurtosis	7.36362619
Mean	30.21090881
Median Absolute Deviation (MAD)	0.73
Skewness	2.24755284
Sum	1171125.88
Variance	5.686604228
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
29.1	264	0.7%
29.14	239	0.6%
29.21	238	0.6%
29.11	230	0.6%
29.18	229	0.6%
29.08	228	0.6%
29.2	227	0.6%
29.13	224	0.6%
29.06	222	0.6%
29.22	221	0.6%
Other values (1458)	36443	94.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
26.66	2	< 0.1%
26.67	9	< 0.1%
26.68	5	< 0.1%
26.69	16	< 0.1%
26.7	27	0.1%
26.71	29	0.1%
26.72	25	0.1%
26.73	35	0.1%
26.74	24	0.1%
26.75	40	0.1%

Value	Count	Frequency (%)
60.21	1	< 0.1%
49.42	1	< 0.1%
49	2	< 0.1%
48.83	1	< 0.1%
47.72	1	< 0.1%
47.69	1	< 0.1%
47.66	1	< 0.1%
47.65	1	< 0.1%
47.64	1	< 0.1%
47.63	1	< 0.1%

sensorParms(3)
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	566
Distinct (%)	1.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	47.14262582

Minimum	0.02
Maximum	96.36
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	303.0 KiB

Quantile statistics

Minimum	0.02
5-th percentile	44.72
Q1	46.22
median	47.35
Q3	47.75
95-th percentile	49.01
Maximum	96.36
Range	96.34
Interquartile range (IQR)	1.53

Descriptive statistics

Standard deviation	1.759320023
Coefficient of variation (CV)	0.03731909271
Kurtosis	398.5145838
Mean	47.14262582
Median Absolute Deviation (MAD)	0.59
Skewness	-13.90873338
Sum	1827483.89
Variance	3.095206945
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
47.32	431	1.1%
47.33	418	1.1%
47.65	393	1.0%
47.31	388	1.0%
47.34	382	1.0%
47.63	374	1.0%
47.64	370	1.0%
47.3	359	0.9%
46.2	339	0.9%
47.66	337	0.9%
Other values (556)	34974	90.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.02	29	0.1%
43.86	1	< 0.1%
43.88	2	< 0.1%
43.89	3	< 0.1%
43.9	8	< 0.1%
43.91	13	< 0.1%
43.92	26	0.1%
43.93	20	0.1%
43.94	17	< 0.1%
43.95	8	< 0.1%

Value	Count	Frequency (%)
96.36	1	< 0.1%
49.5	2	< 0.1%
49.49	1	< 0.1%
49.48	5	< 0.1%
49.47	6	< 0.1%
49.46	14	< 0.1%
49.45	33	0.1%
49.44	39	0.1%
49.43	32	0.1%
49.42	46	0.1%

sensorParms(4)
Real number (ℝ)

HIGH CORRELATION
SKEWED

Distinct	21
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.02181478137

Minimum	-4.35
Maximum	12.08
Zeros	3
Zeros (%)	< 0.1%
Negative	10
Negative (%)	< 0.1%
Memory size	303.0 KiB

Quantile statistics

Minimum	-4.35
5-th percentile	0.02
Q1	0.02
median	0.02
Q3	0.02
95-th percentile	0.02
Maximum	12.08
Range	16.43
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.1645816445
Coefficient of variation (CV)	7.544501209
Kurtosis	2398.917987
Mean	0.02181478137
Median Absolute Deviation (MAD)	0
Skewness	36.49924599
Sum	845.65
Variance	0.02708711769
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=21)

Value	Count	Frequency (%)
0.02	38735	99.9%
-4.34	4	< 0.1%
0	3	< 0.1%
-4.35	3	< 0.1%
6.33	2	< 0.1%
6.52	2	< 0.1%
6.46	2	< 0.1%
11.91	1	< 0.1%
12.08	1	< 0.1%
0.04	1	< 0.1%
Other values (11)	11	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-4.35	3	< 0.1%
-4.34	4	< 0.1%
-4.33	1	< 0.1%
-4.3	1	< 0.1%
-4.08	1	< 0.1%
0	3	< 0.1%
0.02	38735	99.9%
0.04	1	< 0.1%
6.3	1	< 0.1%
6.31	1	< 0.1%

Value	Count	Frequency (%)
12.08	1	< 0.1%
11.91	1	< 0.1%
6.53	1	< 0.1%
6.52	2	< 0.1%
6.51	1	< 0.1%
6.5	1	< 0.1%
6.48	1	< 0.1%
6.46	2	< 0.1%
6.45	1	< 0.1%
6.34	1	< 0.1%

sensorParms(5)
Real number (ℝ)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	722
Distinct (%)	1.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2.601192829

Minimum	-4.35
Maximum	141.87
Zeros	15194
Zeros (%)	39.2%
Negative	5656
Negative (%)	14.6%
Memory size	303.0 KiB

Quantile statistics

Minimum	-4.35
5-th percentile	-4.34
Q1	0
median	0
Q3	6.48
95-th percentile	6.67
Maximum	141.87
Range	146.22
Interquartile range (IQR)	6.48

Descriptive statistics

Standard deviation	5.3012326
Coefficient of variation (CV)	2.038000621
Kurtosis	171.4749783
Mean	2.601192829
Median Absolute Deviation (MAD)	4.34
Skewness	7.626303531
Sum	100835.24
Variance	28.10306708
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	15194	39.2%
-4.35	1269	3.3%
6.67	1260	3.3%
-4.34	1187	3.1%
6.53	870	2.2%
6.54	854	2.2%
6.52	783	2.0%
6.5	752	1.9%
6.51	720	1.9%
-4.33	716	1.8%
Other values (712)	15160	39.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-4.35	1269	3.3%
-4.34	1187	3.1%
-4.33	716	1.8%
-4.32	580	1.5%
-4.31	368	0.9%
-4.3	200	0.5%
-4.29	147	0.4%
-4.28	87	0.2%
-4.27	52	0.1%
-4.26	54	0.1%

Value	Count	Frequency (%)
141.87	1	< 0.1%
138.58	1	< 0.1%
137.33	1	< 0.1%
137.3	1	< 0.1%
137.18	1	< 0.1%
137.09	1	< 0.1%
136.3	1	< 0.1%
136.13	1	< 0.1%
135.62	1	< 0.1%
135.6	1	< 0.1%

sensorParms(6)
Real number (ℝ)

HIGH CORRELATION
HIGH CORRELATION

Distinct	3195
Distinct (%)	8.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	110.9819285

Minimum	-1.39
Maximum	155.73
Zeros	1
Zeros (%)	< 0.1%
Negative	7
Negative (%)	< 0.1%
Memory size	303.0 KiB

Quantile statistics

Minimum	-1.39
5-th percentile	96.4
Q1	99.67
median	102.81
Q3	133.09
95-th percentile	138.25
Maximum	155.73
Range	157.12
Interquartile range (IQR)	33.42

Descriptive statistics

Standard deviation	16.65983778
Coefficient of variation (CV)	0.1501130679
Kurtosis	0.3925886157
Mean	110.9819285
Median Absolute Deviation (MAD)	4.11
Skewness	0.6430477121
Sum	4302214.46
Variance	277.5501947
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
103.51	74	0.2%
101.72	66	0.2%
96.55	64	0.2%
103.65	63	0.2%
103.54	63	0.2%
101.36	61	0.2%
96.54	60	0.2%
101.6	59	0.2%
103.48	57	0.1%
103.61	57	0.1%
Other values (3185)	38141	98.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-1.39	1	< 0.1%
-1.35	1	< 0.1%
-0.73	1	< 0.1%
-0.69	1	< 0.1%
-0.57	1	< 0.1%
-0.11	1	< 0.1%
-0.02	1	< 0.1%
0	1	< 0.1%
0.06	1	< 0.1%
0.1	1	< 0.1%

Value	Count	Frequency (%)
155.73	1	< 0.1%
155.26	1	< 0.1%
155.09	1	< 0.1%
154.99	1	< 0.1%
154.84	1	< 0.1%
154.64	1	< 0.1%
154.6	1	< 0.1%
154.31	1	< 0.1%
154.29	1	< 0.1%
154.15	1	< 0.1%

sensorParms(7)
Real number (ℝ)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	403
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-0.2549722688

Minimum	-2.24
Maximum	36.92
Zeros	194
Zeros (%)	0.5%
Negative	21126
Negative (%)	54.5%
Memory size	303.0 KiB

Quantile statistics

Minimum	-2.24
5-th percentile	-1.94
Q1	-0.89
median	-0.22
Q3	0.2
95-th percentile	1.33
Maximum	36.92
Range	39.16
Interquartile range (IQR)	1.09

Descriptive statistics

Standard deviation	0.9763707822
Coefficient of variation (CV)	-3.829321466
Kurtosis	53.41205635
Mean	-0.2549722688
Median Absolute Deviation (MAD)	0.5
Skewness	1.428705932
Sum	-9884
Variance	0.9532999044
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.13	1811	4.7%
0.12	1243	3.2%
0.11	989	2.6%
0.14	495	1.3%
0.1	405	1.0%
0.15	353	0.9%
1.35	338	0.9%
-0.98	318	0.8%
1.34	303	0.8%
-0.62	299	0.8%
Other values (393)	32211	83.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-2.24	1	< 0.1%
-2.23	4	< 0.1%
-2.22	3	< 0.1%
-2.21	1	< 0.1%
-2.2	1	< 0.1%
-2.19	1	< 0.1%
-2.18	6	< 0.1%
-2.17	5	< 0.1%
-2.16	10	< 0.1%
-2.15	13	< 0.1%

Value	Count	Frequency (%)
36.92	1	< 0.1%
6.09	1	< 0.1%
2.53	1	< 0.1%
2.06	1	< 0.1%
1.98	2	< 0.1%
1.97	8	< 0.1%
1.96	7	< 0.1%
1.95	12	< 0.1%
1.94	18	< 0.1%
1.93	15	< 0.1%

sensorParms(8)
Real number (ℝ)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	432
Distinct (%)	1.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-0.2273328002

Minimum	-2.24
Maximum	66.027
Zeros	193
Zeros (%)	0.5%
Negative	21119
Negative (%)	54.5%
Memory size	303.0 KiB

Quantile statistics

Minimum	-2.24
5-th percentile	-1.94
Q1	-0.89
median	-0.22
Q3	0.2
95-th percentile	1.33
Maximum	66.027
Range	68.267
Interquartile range (IQR)	1.09

Descriptive statistics

Standard deviation	1.504213734
Coefficient of variation (CV)	-6.616791475
Kurtosis	731.6880945
Mean	-0.2273328002
Median Absolute Deviation (MAD)	0.5
Skewness	20.25822299
Sum	-8812.556
Variance	2.262658958
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.13	1810	4.7%
0.12	1240	3.2%
0.11	988	2.5%
0.14	494	1.3%
0.1	404	1.0%
0.15	352	0.9%
1.35	338	0.9%
-0.98	318	0.8%
1.34	303	0.8%
-0.62	299	0.8%
Other values (422)	32219	83.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-2.24	1	< 0.1%
-2.23	4	< 0.1%
-2.22	3	< 0.1%
-2.21	1	< 0.1%
-2.2	1	< 0.1%
-2.19	1	< 0.1%
-2.18	6	< 0.1%
-2.17	5	< 0.1%
-2.16	10	< 0.1%
-2.15	13	< 0.1%

Value	Count	Frequency (%)
66.027	1	< 0.1%
66.002	1	< 0.1%
65.062	1	< 0.1%
61.095	1	< 0.1%
56.053	1	< 0.1%
56.041	1	< 0.1%
54.113	1	< 0.1%
50.057	1	< 0.1%
49.044	1	< 0.1%
48.981	1	< 0.1%

sensorParms(9)
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	11350
Distinct (%)	29.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	32.86431771

Minimum	0.836
Maximum	81.036
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	303.0 KiB

Quantile statistics

Minimum	0.836
5-th percentile	4.045
Q1	16.087
median	32.023
Q3	47.987
95-th percentile	67.902
Maximum	81.036
Range	80.2
Interquartile range (IQR)	31.9

Descriptive statistics

Standard deviation	19.80233482
Coefficient of variation (CV)	0.6025481798
Kurtosis	-0.9299153467
Mean	32.86431771
Median Absolute Deviation (MAD)	15.937
Skewness	0.2488560722
Sum	1273985.276
Variance	392.1324642
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
21.089	18	< 0.1%
47.06	17	< 0.1%
9.129	16	< 0.1%
12.067	15	< 0.1%
50.049	15	< 0.1%
44.066	15	< 0.1%
45.062	15	< 0.1%
37.095	15	< 0.1%
39.066	15	< 0.1%
21.095	14	< 0.1%
Other values (11340)	38610	99.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.836	1	< 0.1%
0.839	1	< 0.1%
0.844	1	< 0.1%
0.848	1	< 0.1%
0.849	1	< 0.1%
0.85	1	< 0.1%
0.851	1	< 0.1%
0.852	2	< 0.1%
0.854	1	< 0.1%
0.855	2	< 0.1%

Value	Count	Frequency (%)
81.036	1	< 0.1%
81.008	1	< 0.1%
80.995	1	< 0.1%
80.994	1	< 0.1%
80.983	1	< 0.1%
80.959	1	< 0.1%
80.897	1	< 0.1%
80.811	1	< 0.1%
80.651	1	< 0.1%
80.53	1	< 0.1%

sensorParms(10)
Real number (ℝ)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	523
Distinct (%)	1.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	8.243073133

Minimum	-0.08
Maximum	25.85
Zeros	0
Zeros (%)	0.0%
Negative	1
Negative (%)	< 0.1%
Memory size	303.0 KiB

Quantile statistics

Minimum	-0.08
5-th percentile	7.02
Q1	7.75
median	8.13
Q3	8.59
95-th percentile	9.71
Maximum	25.85
Range	25.93
Interquartile range (IQR)	0.84

Descriptive statistics

Standard deviation	0.9404754279
Coefficient of variation (CV)	0.1140928162
Kurtosis	54.83625849
Mean	8.243073133
Median Absolute Deviation (MAD)	0.4
Skewness	3.244775247
Sum	319542.73
Variance	0.8844940305
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
7.77	751	1.9%
7.76	738	1.9%
7.78	626	1.6%
7.75	595	1.5%
7.74	549	1.4%
7.79	402	1.0%
8.25	375	1.0%
8.24	374	1.0%
7.73	372	1.0%
8.26	358	0.9%
Other values (513)	33625	86.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-0.08	1	< 0.1%
4.66	1	< 0.1%
4.68	1	< 0.1%
4.83	1	< 0.1%
4.85	3	< 0.1%
4.88	2	< 0.1%
4.89	3	< 0.1%
4.93	1	< 0.1%
4.95	1	< 0.1%
4.96	1	< 0.1%

Value	Count	Frequency (%)
25.85	1	< 0.1%
25.82	1	< 0.1%
25.69	1	< 0.1%
25.63	1	< 0.1%
25.52	1	< 0.1%
25.51	1	< 0.1%
25.48	1	< 0.1%
25.47	1	< 0.1%
25.13	1	< 0.1%
24.98	1	< 0.1%

sensorParms(11)
Real number (ℝ)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1363
Distinct (%)	3.5%
Missing	29
Missing (%)	0.1%
Infinite	0
Infinite (%)	0.0%
Mean	23.41034851

Minimum	-1.69
Maximum	29.22
Zeros	0
Zeros (%)	0.0%
Negative	1
Negative (%)	< 0.1%
Memory size	303.0 KiB

Quantile statistics

Minimum	-1.69
5-th percentile	19.52
Q1	22.14
median	22.85
Q3	25
95-th percentile	28.29
Maximum	29.22
Range	30.91
Interquartile range (IQR)	2.86

Descriptive statistics

Standard deviation	2.416969123
Coefficient of variation (CV)	0.1032436199
Kurtosis	1.521775682
Mean	23.41034851
Median Absolute Deviation (MAD)	1.16
Skewness	-0.1383200357
Sum	906823.26
Variance	5.841739742
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
22.16	310	0.8%
22.17	295	0.8%
22.19	274	0.7%
22.18	262	0.7%
22.2	255	0.7%
22.14	246	0.6%
22.21	245	0.6%
22.13	244	0.6%
22.15	238	0.6%
22.12	224	0.6%
Other values (1353)	36143	93.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-1.69	1	< 0.1%
12.64	1	< 0.1%
12.82	1	< 0.1%
13	1	< 0.1%
13.11	1	< 0.1%
13.16	1	< 0.1%
13.35	1	< 0.1%
13.37	1	< 0.1%
13.4	1	< 0.1%
13.43	2	< 0.1%

Value	Count	Frequency (%)
29.22	1	< 0.1%
29.09	1	< 0.1%
29.05	1	< 0.1%
29.04	1	< 0.1%
29.02	3	< 0.1%
29.01	5	< 0.1%
29	6	< 0.1%
28.99	8	< 0.1%
28.98	8	< 0.1%
28.97	12	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	df_index	TIMESTAMP	_RS232Dpt	sensorParms(1)	sensorParms(2)	sensorParms(3)	sensorParms(4)	sensorParms(5)	sensorParms(6)	sensorParms(7)	sensorParms(8)	sensorParms(9)	sensorParms(10)	sensorParms(11)
0	2	2020-06-09 15:14:06	0.912	11.428	34.73	46.88	0.02	6.48	142.91	1.05	1.05	0.912	7.31	19.23
1	3	2020-06-09 15:15:39	2.134	10.806	34.18	46.89	0.02	6.48	141.16	1.09	1.09	2.134	7.65	20.12
2	4	2020-06-09 15:17:11	3.140	10.649	34.04	46.90	0.02	6.47	141.02	1.08	1.08	3.140	7.69	20.24
3	5	2020-06-09 15:18:43	4.122	10.375	33.79	46.89	0.02	6.45	141.10	1.06	1.06	4.122	7.79	20.50
4	6	2020-06-09 15:20:15	5.107	10.043	33.51	46.91	0.02	6.44	140.44	1.06	1.06	5.107	7.90	20.78
5	7	2020-06-09 15:21:47	6.132	8.997	32.59	46.93	0.02	6.43	140.76	1.12	1.12	6.132	8.20	21.58
6	8	2020-06-09 15:23:19	7.116	8.953	32.57	46.96	0.02	6.41	140.73	1.09	1.09	7.116	8.23	21.67
7	9	2020-06-09 15:24:51	8.120	8.710	32.36	46.97	0.02	6.40	140.76	1.12	1.12	8.115	8.30	21.85
8	10	2020-06-09 15:26:23	9.110	7.998	31.72	46.97	0.02	6.39	140.07	1.10	1.10	9.106	8.54	22.49
9	11	2020-06-09 15:27:56	10.160	7.803	31.58	47.03	0.02	6.37	140.02	1.11	1.11	10.163	8.63	22.73

Last rows

	df_index	TIMESTAMP	_RS232Dpt	sensorParms(1)	sensorParms(2)	sensorParms(3)	sensorParms(4)	sensorParms(5)	sensorParms(6)	sensorParms(7)	sensorParms(8)	sensorParms(9)	sensorParms(10)	sensorParms(11)
38755	38757	2022-08-19 01:04:15	41.04	5.899	30.34	47.77	0.02	6.32	100.85	1.15	1.15	41.043	8.67	23.11
38756	38758	2022-08-19 01:05:48	42.03	5.842	30.29	47.77	0.02	6.31	100.65	1.17	1.17	42.030	8.68	23.14
38757	38759	2022-08-19 01:07:24	43.08	5.775	30.25	47.80	0.02	6.31	100.42	1.17	1.17	43.084	8.68	23.15
38758	38760	2022-08-19 01:08:57	44.01	5.705	30.19	47.80	0.02	6.30	100.47	1.18	1.18	44.012	8.70	23.20
38759	38761	2022-08-19 01:10:30	45.02	5.692	30.18	47.82	0.02	6.31	100.43	1.14	1.14	45.023	8.70	23.21
38760	38762	2022-08-19 01:12:07	46.09	5.666	30.16	47.82	0.02	6.30	100.43	1.16	1.16	46.089	8.72	23.26
38761	38763	2022-08-19 01:13:43	47.11	5.641	30.15	47.83	0.02	6.30	100.39	1.11	1.11	47.108	8.69	23.16
38762	38764	2022-08-19 01:15:16	48.03	5.632	30.14	47.84	0.02	6.30	100.29	1.16	1.16	48.032	8.71	23.22
38763	38765	2022-08-19 01:16:53	49.12	5.622	30.14	47.84	0.02	6.30	100.21	1.18	1.18	49.121	8.73	23.27
38764	38766	2022-08-19 01:18:29	50.08	5.599	30.11	47.84	0.02	6.29	100.03	1.16	1.16	50.076	8.72	23.24

Overview

Variables

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows